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ABSTRACT 

Present automated systems of interpretation which apply 
pattern recognition techniques on MSS data do not fully 
consider the geometry of the acquisition system. Metric 
information cannot therefore be extracted from the data 
at the same time that Interpretation is performed. In an 
effort to improve the usefulness of the MSS data when dig- 
itally treated, geometric aspects are analyzed and discu- 
ssed, Attempts to correct for scanner instabilities in 
position and orientation by affine and polynomial trans- 
formations, as well as by modified collinearity equations 
are described. Methods of accounting for panoramic and 
relief effects are also discussed. It is anticipated that 
reliable area as well as position determinations can be 
accomplished during the process of automatic interpreta- 
tion. The paper is concluded by presenting a concept for 
a unified approach to the treatment of remote sensing data, 
both metric and non-metric. 


*Thia jjaper was presented at the Spring Convention of the American 
Society of Photogrammetry, Washington, D.Co March This 
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INTRODUCTION 


Remote sensing is an all inclusive term used to describe 
information recording about objects and phenomena without 
physical contact, and the analysis of the recorded 
information. Therefore, conventional activities of 
photogrammetry and photointerpretation fall within the 
realm of remote sensing. 

There are many remote sensing systems which may be 
classified according to different criteria: (1) whether 

stationary or on .a moving platform, (2) whether image-- forming 
or not, (3) whether passive or active, and (4) according to 
the geometric characteristics of the information gathered 
(i,e., positional, directional, distance, etc. ) . When one 
is concerned with information regarding the Earth and its 
environment, sensors on moving platforms, from the air, 
space, or water, are usually used. Furthermore, since 
many of the techniques of evaluation are adapted from 
photogramme trie and interpretive techniques developed in 
the past, interest focuses on remote systems with potential 
image -forming capability. 

TSie active -passive classification depends upon whether the 
sensor generates its own source of energy or not. Passive 
systems are those responding to energy reflected or 
re-emitted from the object space and include: cameras such 

as frame, panoramic, or continuous strip? optical -mechanical 
scanners such as the infrared line scan (IRLS) , multi-spectral 
scanner (MSS), etc.? and radiometers, such as conical, 
zig zag, etc. Active image-forming systems generate their 
own signals, such as radar (rotating PPX, side-looking SleAR 
with realor synthetic aperture), or sonar. 

Classification as regards geometry would include area 
recording (e.g., frame camera), line recording (e.g., 
panoramic and continuous strip cameras), or point recording 
(e.g., optical mechanical scanners and scanning radiometers). 
The information may be related to position, or to distance 
by echo-time as in radar. 

This brief review, then, indicates that the system of 
interest in this paper, the MSS, is a passive system used on 
a moving platform, both aircraft and spacecraft, with 
potential image formation, and records object data in a point 
by point mode. The term ’*point“ is used here to mean a 
small, though finite, area representing the system’s 
resolution element as will be explained in detail later on. 

The potential of MSS, and of remote sensors in general, is 
becoming more apparent as man attempts to cope with a variety 
of problems from resources mapping to environmental monitoring 
These systems are utilized aboard aircraft, as well as space- 
craft such as the present ERTS, and planned Sky lab. In order • 
to appreciate the nature and amount of data acquired by the 
MSS system a brief description of its basic concept is given. 
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1?he MSS eystem 


In simplified terms, the multispectral scanner contains a 
rotating prism which scans the terrain in narrow strips or 
lines oriented normal to the direction of flight. The 
forward motion of the aircraft provides continuous coverage 
by allowing some overlap between successive strips. The 
incoming energy reflected off the rotating prism is divided 
into several wavelength bands, each band recorded separately 
(figure la) • 

At any instant of time, energy from a finite object area 
(4x)(^y), see figure lb, determined by the angular 
resolution of the system, is represented by a set of numbers, 
one for each band. In each band, the number for one resol- 
ution element represents the spectral radiance from that 
area on the terrain- A fixed number of consecutive resolution 
elements side by side form a scan line. The data is usually 
recorded on magnetic tape, which after pre-processing yields 
the information in digital form. For each resolution 
element, there is a position in a matrix representing the 
scan line number in one dimension, and the element number 
within that line, in the other dimension. Associated with 
that position would be several spectral values equal in 
number to the spectral bands of the system. 

Data in this format is so extensive that only automted 
digital techniques would be practical for its processing. 

One such digital system, which relies on pattern recog- 
nition and statistical classification algorithms, has been 
developed at the Laboratory for Applications of Remote 
Sensing (LARS) of Purdue University. This system makes 
possible efficient analysis, interpretation, and classifi- 
cation of such digital data automatically. 

Extensive digital algorithms for automatic interpretation 
have by necessity disregarded or subordinated the geometrical 
aspects of the acquisition system- These algorithms relied 
extensively on strictly statistical techniques. To the 
photograrnmetrist, however, such approach may be unnecessary 
since functional models can be constructed and utilized, 
perhaps with simplifications, without resorting to stochastical 
methods. Recognition of the geometric elements of the system, 
and proper account for them, would improve the interpretive 
results, as well as provide further useful quant itiative 
information from the data. 

THE REMOTE SENSING TRANSFORMATION FOR MSS 

Remote sensing can be thought of as a mapping of a multi- 
dimensional space onto another space with the same or fewer 
dimensions. This mapping may be considered in a general 
sense to be effected through a transformation taking a 
multidimensional vector into another multidimensional vector. 

We shall call this the remote sensing transformation , which 
transforms an object space vector into a sensor space vector . 
The dimensions of each vector will depend upon the degree 
of simpliciation of the physical phenomena involved, and 
the characteristics of the sensor to be employed. 
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Treated generally, the concept of remote sensing as a 
transformation is a broad approach intended to amalgamate 
two classically separated activities: the interpretive and 
the quantitative. It attempts to unify both the metric and 
non-metric aspects of remote sensing. Therefore, the elements 
of the vectors involved may include geometric, dynamic, and 
energy components, with corresponding broadening of the 
transformation parts. This unified approach is considered 
beyond the scope of this specific discussion, although 
further comments will be presented at the end of this paper. 

Restricting the discussion .to the MSS. system, it is useful 
to note that passive optical-mechanical scanners can operate 
in several modes 2 

(a) Scanning in a plane normal to the flight direction 

(b) Scanning in a plane oblique to the flight direction 
rotated about a horizontal a«is normal to flight 
direction 

(c) Hyperbolic Scan, or scanning in a cone with the flight 
direction as an axis 

(d) Circular scan, or scanning in a cone with a vertical ascis 

The ays tern with which this presentation is concerned is that in 
(a), because it is at present the more common, although the 
other three systems are available and may gain favor of use 
in the future o (The circular scan of (d) above is planned 
for sky lab «) 

To facilitate the understanding of the development to follow, 

WB shall divide the sensing transformation into two'partsj 
one concerned with geometric and time factors, and the other 
with energy aspects. We shall further concentrate on the 
first type of transformation since it composes the main theme 
of this paper. 

In order to construct the sensor transformation, it is perhaps 
easier if one visualizes that the data from MSS forms an image 
instead of an array of numbers, one picture element or "pixel” 
for every spectral value number. The two dimensions of the 
matrix of numbers would be then equivalent to the size of 
the plane of imagery. Since each pixel, or spectral number, 
is recorded at a particular instant of time, then time as a 
variable (or element of both the object space and sensor 
space vectors) plays an important role. Therefore, let the 
following be the basic variables: 

epoch or time of beginning of recording (at 
zero x-coordinate) 

time period for one revolution of the scanner 
Tf. time of recording point J on scan line i 


k 





2 C< 




y* 

^13 




KJj.kij 


instantaneous scan angle when point j is 
recorded (see figure lb) 

total scan angle { oc on either side of plumb 
line) 

constant representing a ••principal distance", 
or the equivalent of the radius of the 
cylindrical recording drum 

speed representing ••film” advance when 
pictorial recording, or its equivalent 
when recording in other modes (magnetic tape, 
etc«), taken as a constant 

cartesian coordinates of point P^. (either image 
or its equivalent in digital recording), see 
figure 2 

distance along scan line i between x*^axis 
and 

instantaneous orientation matrix at 
(taking object system to sensor system) 

scale factors between object and sensor spaces 
for point j on scan line i, ^/cos 0 ) 


instantaneous position of exposure station 

•= <= <=« .tTjj 


(X,Y,2). 


object coordinates of any point 


With the above variables, the following general relations 
may be written directly: 

o(- 

®ij “ 

where i is the scan line number on which lies 
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0 

0 

COS0^^ 

0 

-sinfl, , 


0 

' ^ij 

^j“^cij 


0 

®in0ij 

cos^^. 


-c 


."r'cij 


On the basis of (2)i (3), and (5) the four-dimensional, 
sensor transformation becomes 


*ij 


r - 


’^ij-'^o 

0 


V ^ 


*j‘*cij 

^ (ili) 

C 

= 

0 *i3(t) 

3,3 



k. . 

L ID J 




z.-z . . 

^ 3 CJ-Dj 

4,1 


^uation (6) represents a rather general transformation 
for ^^en' toe scanning is performed in a plane normal 
direction of fXi^hte For otiier inodes of scsnninc^ 
simllsir trans forma tions can be derived* 

In order to incorporate metric aspects into an extensive 
program for automatic interpretation, it is more practical 
to begin with a much simplified case,, and progressively 
proceed toward toe general situation given above. This is 
the way the research, on which this paper reports, actually 
proceeded « ^ 


ASSUMED IDEAL GEOMETRY 

. The simplest case is to asstone ideal flight conditions, 
thus A(t) = Ic and 2^ «= constant above datum* This ideal- 
ised Situation is depicted in figure 3, in which (XpY,2)^ 
are the object coordinates of any point j* Other para- 
meters include i the angular resolution Jf, aircraft velo- 
city V, and an overlap factor of adjacent scan lines,. S. 
With the orientation matrix being identity, equation (6) 
yields 

Xf X-Q is the X-coordinate of toe exposure station at 
beginning of recording, then X(.j. may be given by 


3 cj CO 



vdt 


(B) 
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where Ta the time at the recording of point J. ^ 
afisxune me overlap factor S is maintained constant^ then 
from figure 3a one may write 

(l-S)dx ^ Vdt (9) 

Since S is defined at the datumt then the left hand side 
may be written in terms of the sensor space as 

(i-s)ax « (i-s)^dx (io) 

C 

and equation (8) becomes 

Z 

“ ’‘cj “ *co **• / 

where is the image x-coordinate of point J. Note that 
at the epoch , x « o, hence is assumed to be zero, for 

slmplicity« Equations (8) and (XI) are general expressions 
for computing the X**coordinate of any ^int J under the 
above-stated assumptions « If in addition to $ is also 
assumed constant (i«e* independent of or consequently 
of time) equation (11) simplifies to 



CO 


Z^(l-S)x. 

c 


( 12 ) 


If we assume further that the scan rate is so fast that 
each scan line is considered recorded instantaneously^ 
then y* becomes equal to y# 

The Y-coordinate may be obtained from (6) directly, since 
with A = I, 


c 


or 




- c" “ z . - z 

kj c 

Yj = Y^J + tan (i) 


( 13 ) 
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EFFECTS OF SCAN, TOPOGRAPHY, AND SENSOR EXTERIOR ORIENTATION 

The idealized geometry assumed in the preceding section is 
obviously not realized in practice* ■ There are several 
factors which occur and which affect the coordinates as 
derived by equations (12) and (13). Although if equation 
(6) IS used directly these factors would be directly 
accounted for, we shall treat each separately in order to 
gain insight into the system. 


(I) As shown in figure 3b, recording is done on a 
cylindrical, instead of a plane surface. This 
causes a panoramic appearance, which will be 
termed "scan angle effect". 

(J) Removing the assumption that the object- is a plane, 
leads to assigning elevations to different resolution 
elements. This will be called "topographic effect". 

(3) Relaxing the assumption of ideal flight conditions 
leads to "sensor exterior orientation effects". 

(4) When the assumption that each scan line is instantan- 
.. eously recorded is not adhered to, then the effect 

of a finite time of scan will be designated "scan 
time effect"* 

of tl\e ebove four effects wilX be dddressed separeteXy* 
Scan anqXe effect 


Figure 3b shows that A* is the position of point J on a 
plane# whiXe A is the point actuaXXy recorded* The difference 
IQ 

dy *= OA* - OA «= c(tan 0^- 0^) (^ 4 ) 

which represents the dispXacement due to scan angXe effect* 
Note tha t 


j “ ~ '^sed in equation (X3) . (See aXso 

equation (3) ) , within each scan Xine# the resoXution eXeroent 
on the ground changes due to the same effect* The coverage 
of the scan Xine on the ground accordingly takes the shape 
of a "bow tie"# and the effect is therefore often referred 
to by that name. From figure Xb# one may directXy writes 


AX e y z) sec $ 


(15) 


AY «= S* Z) sec^0 


(16) 


If one approximates the area of ground resoXution eXement A A 
by the product of AX and Ay# then 


AA = _ z)2 sec^0 


(17) 
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which implies a considerable variation of AA with the 
scan angle. As an example, if (z - Z) - 5000 ft., 
y « 3 mxad, then^A - 15* x 15* St nadir, and 
A A « (/iX) (Ay) == 19.5* X 25.5* at 0=^ 40°, 

To illustrate the change in the dimension of the resolution 
element in the scan direction, AY, figure 4 shows several 
plots. It depicts the variation in ^Y as a percentage of 
flying height above terrain (2 - 2), due to change in 

scan angle Q, for a number of values of the angular 
resolution . 

Topographic effect 

Current interpretive systems assume flat terrain. This 
simplification can -lead to serious planimetric displacement, 
as displayed in figure 5, given by 

&Y ^ 62 tan0 ( 13 ) 

In equation (18), ^2 may represent total elevation if 
topographic effects have been totally neglected, or it 
may represent some height error, if some effort in assign*- 
ing elevations to scan elements has been attempted. It is 
clear that 8 y = 0 at nadir, $Y » 6z at 0- 45^, and 5v 
would increase rather rapidly as 0 increases beyond 45^, 

Sensor exterior orientation effect 

Equation (6) shows that both position and orientation of 
the sensor are functions of time, and therefore the 
assumption of ideal flight conditions is not realistic, 

' The variations in elements of sensor exterior orientation 
are in general random, but the cumulative effect of these 
variations may be deterministico (4) This led several in- 
vestigators (4,8,9) to model the behaviour of these ele- 
ments using such functions as polynomials and harmonics. 

Ideally, the mathematical functions expressing the behav- 
iour of exterior orientation elements should be in terms 
of time. However, time may not be recorded with suffi- 
cient accuracy to be relied upon for such analysis « In- 
stead, if we utilize the concept of, v, as a constant 
effective speed of **film" travel, as mentioned previously, 
then the x -coordinate of the "imagery** may replace time in 
these functions. When the data recording is in the form 
of digital arrays^ x may further be replaced by the scan 
line number i as the independent variable. 

Thus, if y is assumed to vary as a second order polyno- 
mial in time 

\ “ ®o + ®2 (19) 

then from (2), with T_ assumed zero^, t may be replaced by 
h/v leading to ® 

®1 * + (20) 
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where = aj^/v (21) 

The effect of variations in the orientation elements can 
be derived directly from equation (6) . if we use 9 for 
y/c and h for c/k, the 3-dimensional geometric portion of 
the transformation in (6), when inverted, becomes 



Starting with the case at A ^ X, we study the effect of 
small angles dco, d4>, dit on"^the coordinates x#Y of an object 
point, under A = equations (7) and (13) give the X, Y 
coordinates of the point, remembering that here 

h w 2^ — Z • 


Xt can be readily shown that 



which under the assumptions of initial ^ ^ 2 and smsll 
angles become 


dco 


0 

0 


0 

0 


• 

0 

dio 

C: 

-1 


" 0 

1 

VS] 

0 

0 

X t 


“d6o 

0 

0 


-1 

0 

0 (24) 

1 

0 

34 - 

1 

0 

0 

3 * 

0 

0. 

0 


Equation (22) may now be differentiated to obtain the effects 
of angular and positional changes in the exterior elements. 
Note that differentiation with respect to h must also be 
performed since in it is contained the scale factor k 
which is a variable for each point. 



It is important to point out that equation (22) is a pro- 
jection from sensor space (which is essentially two-dim- 
ensional) to three-dimensional object space. Therefore it 
is not possible from single imagery to determine all three 
coordinates (X, Y, Z), because another unknown scale fac- 
tor k is implicit in h. Therefore, as has been the prac- 
tice in deriving differential formulas, we assume Z con- 
stant. consequently, from the third equation in (25), 
enforcing d Z ^ 0, one gets 
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dZ = h tan/9 dtO - dh 
c 

from which 

dh ss dZ^ + h tan B doJ (26) 

c 

tJ 3 ing (26) in the upper two equations of (25) and neglect- 
ing terms of second order gives s 

dx « dX^ « h d(}) - h tan5 d/^ (27a) 

dV « dY^ + tan^ d Z^ + h sec^^ do^ (27b) 

If we assume that z is also a constant^ h will be a cons- 
tant and the equatiSns in (27) may be added to equations 
( 7 ) and (13) to yield 

X = X +dX -hd^-h tan0 d^ (28a) 

c c 

Y - + dY^ + h tan^ + tan^ dZ^ + h sec^0 dco (28b) 

The equations in (28) are the final form for evaluating the 
planimetric coordinates of an object pointo Series expan- 
sion of (tan^), substituting back for B, and selecting 
appropriate polynomials for the exterior orientation ele- 
ments, X , Y (note that dX , dY would be absorbed into 
the coAs tan terms of the pSlynoSials ) , dco, d(po d;e, would 
lead to the final polynomial expressions^ These may be 
used in a usual interpolation operation using least squares 
if redundant horizontal control is available * 


As an example, taking the first two terms in the expansion 
of tan ^ and using (tan*^ ^ 1 ) s s^c^B , 

and linear polynomials in x for the exterior orientation 
elements, leads tos 


X « A^ X + *3 

Y = X + y + B 3 

2 2 
+ Bg y + xy t 


3 3 

xy A^ y + A^ xy (29) 

3 3 

xy -f y * 9-^5 3 cy 

Bg xy\ yV B 3 ^j^xy^( 30 ) 


In Some systems, the angle to rnay be stabilized to less than 
one resolution element and therefore the last term in equa- 
tion (28b), and correspondingly the six terms on the sec- 
cond line of equation 30 may be dropped^ 

Once the polynomial coefficients are determined, point-by- 
point numerical rectification may be performed using the 
same polynomials* There are other procedures of interpo- 
lation which may be used in conjunction with remote sens- 
ing data ( 11 ), such as linear least squares interpolation 
(^ 0 )* 
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Scan time effect 


If the assumption that each scan line is recorded instan-* 
taneously is relaxed, then the way data are recorded would 
be as shown in figure 2, a segment of which is enlarged in 
figure 6. The X coordinate of any point may be written as 


X 


2ir< 




(31) 


where X corresponds to the central point (the nadir, under 
ideal flight conditions), V the aircraft velocity, and the 
other symbols as defined before* The effect shown by equ- 
ation (31) can be incorporated with the others given in. 
the preceding section, and polynomials used for the com- 
bined effects. 


If the time period for one revolution t is not known suf- 
ficiently then, the scan time effect cafi be absorbed into 
the term for the angle Z of sensor exterior orientation* 

COLLINEARITY EQUATIONS 


Most photogrammetr ists are familiar with the collinearity 
equations and their use with frame photography, A similar 
pair of equations may be derived for the recording of each 
resolution element using the geometric portion of the tran- 
sformation in (6). 


Writing the elements of A as ay , i ~ j 1^2,3, 

equation (22) may be written as 


X - 

c 



^21 

®3ll 

V - 


®12 

®22 

^32 

2 - 


®13 

®23 

^33 


0 

(cA) tan^ 
~(cA) 


Dividing the first and second equations by the third and 
rearranging 


{X - x^) = 

C 

(z 


®21 

tan0 - 

^31 





®23 

tan^ - 

®33 


£a 

(z 

“ 2 ) 

®21 

sin0 - 

®31 

COS^ 



w 

®23 

sing - 

®33 

cpstg 

II 

> 

(z 

>Z^) 


tang - 

®32 





^23 

tan^ - 

®33 


ei 

(Z 


°22 

sin^ - 

®32 

COS& 




®23 

sinQ - 

®33 

cos ^ 


(32a) 


(32b) 


If A is taken equal to I, a - ■ - 1, and equations (32 ) reduce 
to the same results given in^the section of idealized geo- 
metry, If six exterior orientation elements were assumed 
unknown for each scan, it would foe impossible to have a 
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a solution and derive information from MSS data* Therefore^ 
some type of functional behaviour (polynomials, etc*) must 
be assumed for these elements. Once decided, object space 
control may be used to determine the coefficients of these 
functions (resection), then equations (32) used to deter- 
mine positions of other object points (intersection) . The 
result would be a “rectified” data array. Obviously, all 
operations using equations (32) may be performed simultan- 
eously. 


EXPERIMENTAL RESEARCH 

To incorporate the results of the analyses given above, a 
series of experimental steps were carried out in conjunc- 
tion with LARS automated interpretive system. A descrip- 
tion of these steps is given in the following subsections. 
One of the more important tasks is to assign elevations to 
each of the digital resolution elements. Therefore, the 
first subsection is devoted to the discussion of this oper* 
at ion. 

Assignment of element elevation 

Before any geometric corrections can be applied^ an eleva- 
tion 2j must be assigned to each element of the data array. 
This is particularly necessary when the approximate proce- 
dures developed above are used. Element elevations may be 
derived from the MSS data itself if and only if the object 
is scanned more than once. Most present data pertain to 
singly scanned areas, and therefore elevations must be ob- 
tained from sources external to the MSS data. One such 
source j which was used for this investigation, is the top- 
ographic contour maps of the U.S. Geological Survey at a 
scale of 1:24000. The information may be gathered by dig- 
itizing X-Y coordinates along selected contour lines on a 
flat-bed coordinate digitizer. The coordinate information 
for the contours is recorded directly on punched card out- 
put. At the same time, the coordinates of selected ground 
control points may also be recorded. The digitized data 
thus obtained are then transformed to the data using a 
similarity transformation, so that the remaining operations 
may be performed at the image scale. 

At this point, a method must be found to reliably assign 
an appropriate elevation to every data array element. A 
seeming paradox exists, since the digitized contour inform- 
atioHj although at image scale, is in an essentially ortho- 
graphic projection, while the data arrays have all of the 
image displacements and distortions. The solution to the 
problem of superimposing the two data sets lies in the na- 
ture of the data itself. Since the data arrays can resolve 
only to the value, AY, given in equation (16) , it is only 
necessary to be able to assign element elevations with an 
accuracy which will yield a planimetric error of this value 
of less after subsequent processing. Thus, by using AY 
of equation (16) is place of SY in equation (18), as an 
allowable planimetric error, and solving for the allow- 
able height assignment error, the appropriate height as- 
signment tolerance may be written as 





( 33 ) 


Sz *» Ay 

tan S 

z « y ( - z ) 

sin 5 cos 5 ( 34 ) 

Figure 7 shows graphically the magnitude of this allowable 
height assignment error, using equation (34), At nadir, the 
allowable error is infinite since a change in elevation has 
no effect on the image. The value of fiz decreases to a 
minimum at 45°, where planimetric error becomes equal to 
height assignment error. The allowable value then increases 
rapidly beyond 45^, since the ground size of a resolution 
element increases very rapidly beyond this point. 

To superimpose the two data sets within this tolerance, it 
is necessary to find a transformation which will yield a 
height assignment error of less than that given in Figure 
7 q To do this, ground slopes must be considered. 

In Figure 8, the term $Y represents the planimetric error 
in superimposing the MSS digital arrays onto the digitized 
map information. The resulting elevation error is given by 

SZ «^gY; (35) 

in which is the ground slope in the vicinity. . if the 
allowable height assignment error from equation (33) is sub- 
stituted into this expression and the resulting equation 
is solved for £Y, then 

« AY 

Atan0 (3e> 

which represents the allowable planimetric error which may 
be tolerated in an approximate transformation to relate 
data arrays and digitized map information for height assi- 
gnment purposes, and still result in less than a one re- 
solution element planimetric error after subsequent analy- 
sis. In reality, ground slopes rarely exceed 0.5, and scan 
angles 10) normally do not exceed 40°. Thus a transfor- 
mation yielding errors on the order of 3 resolution ele- 
ments may be appropriate for this step- of height assign- 
mente The affine transformation proved adequate for this 
purpose. 

The digital data arrays are processed through the affine 
transformation, to bring them as close as possible to the 
scaled digitized map data. Each digitized contour is then 
traced digitally using a computer program, and all inter- 
sections of this contour with each transformed scan line 
are found. All contour-scan intersections are thus locat- 
ed for every scan line down the strip. Points along the 
scans intermediate between these intersection points may 
be assigned elevations by linear interpolation. 

It should be noted that the affine transformation is used 
only for elevation assignments. The spectral values with- 
in the data arrays are left unaltered, and the element 
positions remain the same before and after element height 





assignments « That is« the image element positions are re«- 
etored to their original distorted positions after the 
assignment of elevations, in order that the more refined 
geometric techniques using polynomials or collinearity equ-» 
ations may be utilized « 

All of the above is predicated upon the fact that only 
singly scanned imagery is available* If overlapping ima- 
gery is available, then it may be possible to compute ele- 
ment elevations from the MSS data itself by forming inter- 
sections* Several investigators (4#8,Yl) have addressed 
this problem within the context of model formation and re- 
lative orientation- Since only singly scanned imagery was 
available for this investigation^ this approach has not 
been considered* 

Application of approximate polynomials 

We have shown previously that polynomials such as those of 
equations (29) and (30), or similar others, can be derived to 
approximate the effects of sensor exterior orientation el- 
ements* To apply these polynomials, it is important that 
scan angle and topographic. effects are accounted for first. 
If the data is acquired over flat terrain, where there is . 
no effect due to topography, the polynomials may be used 
directly since they account for the scan angle through the 
series expansion of tan 0 , etc« This is particularly ap- 
propriate when the scan angles are small* On the other 
hand, when relief exists and the scan angles are not small 
an alternative method derived for use with LARS programs 
(\ 7 ) f may be used* 

The procedure consists of resampling along each scan line 
such that every sample elements represents an equal Y - 
interval on the datum instead of equal angle at sensor. 
Consequently, the total number of elements in each sample 
line remains the same as before resampling* Figure 10 il- 
lustrates t±e geometric basis for the resampling algorithm 
in which: 

n Is the number of samples from beginning of scan 
to nadir 

N is the total number of sample elements in each 

scan line 

is the spectral value in the ith element before 
^ resampling 

S. is the spectral value in the ith element after 
^ resampling 

d. is the distance from the scan edge to the cen- 
^ ter of the ith element 

W is the total width (along datum) of ground cover- 
age 

h^,h^ are the flying heights above the first and last 
elements * 

is the elevation difference between the ith and 
first sample points 

The algorithm seeks to find a variable sample angle, U, V , 
for every element, such that the resampled data repre-^ 
sents elements of equal length on the datum. 
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The multiplier, may be considered as having an integer 
portion, and a fractional portion, and may thus be 
written as 


U, 


Li + C. 


( 37 ) 


The resampling multiplier, may be shown to be given by 
the expression (u 




1 i^nS + tan 

Tl 


+ 21-1 
2N 



tan 



tan 


(38) 


This expression is computed for each element in every scan 
line* The spectral value stored in the ith resampled ele- 
ment may be computed by interpolation of spectral values 
from the original array* If linear interpolation is app- 
lied the result is 


s; =Si. + C, -s,. ) (39) 

Figure 9 displays the effect of resampling on the posi- 
tion of sample points for a real data case. The solid 
line represents an algorithm for flat terrain, while the 
dotted line takes terrain relief (approximately 150 feet) 
into account. Note that sai^le points at the beginning, 
middle, and end of a scan line are displaced very little, 
while those in between experience displacements of as much 
as 7 or 8 elements. 


once resampling is accomplished, polynomials may then be 
used to determine horizontal positions {X, Y) of desired 
points, from given control* Preliminary experience • indi- 
cate that this approximate technique is applicable only 
to relatively flat areas. 

h danger in the use of this method lies in the fact that 
interpolation of spectral values is done during resampling. 
This increases the possiblity that the automated interpre- 
tation algorithms may achieve a lower accuracy of classi- 
fication. 


Application of coll inear ity equations 

The coll inear ity equations of (32a) and (32b) may be appl- 
ied directly to the digital data. Since all our activi*= 
ties for this investigation so far have been concerned 
with simple imagery, elevations of all terrain points of 
interest must be known a priori, as has been discussed pre- 
viously. In order to apply equations (32), some function- 
al form for each of the pertinent elements of sensor ex- 
terior orientation must be assumed, once this is done, a 
rigorous adjustment program may be set up to determine the 
required plan ime trie coordinates in on© simultaneous solu- 
tion. The end result would be a rectified data arrays 
referring to an orthographic system, where each element is 
designated by all three ground coordinates, and contains 
as many spectral values as the number of scanner channels. 
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To demonstrate the application of the collinearity equa- 
tions to geometric analysis of MSS data arrays, two fli- 
ght lines of real data were chosen for analysis. Doth 
were flown during the corn blight watch experiment ad- 
ministered by lARS during the summer of 1971. The first 
of these, flight no* 208, was located in northwestern 
Indiana, near the cityof Lafayette. Terrain variation 
within the flight line is quite small, on the order of 
50 feet over the entire flight line, A large percentage 
of the ground was under cultivation, with no forest cov- 
er* A grey scale computer printout of the data arrays 
for the flight line was generated, from which intersec- 
tion of roads, fences and streams recognizable both on the 
display and the map were chosen as control points. The 
area contains many section roads and fence lines, with 
well defined, nearly perpendicular, intersections. Relia- 
bility in assignment of line-column positions on the grey 
scale display for the control points was on the order of 
one ox two resolution elements. 

The second flight line chosen, flight no. 218, is located 
in west central Indiana, near the city of Bloomington. 

Total terrain variation within the flight line is on the 
order of 300 feet. Most of the area is wooded such that 
a tree canopy obscures much of the ground. Greater dif- 
ficulty was encountered in the determination of array pos- 
itions from the grey scale display for control points with 
this flight line. Uncertainties in array location assign- 
ments of 3 to 4 resolution elements were not unusual. 

For each of the flight lines two analyses were carried out. 
in the first case, one set of functions for the pertinent 
sensor exterior orientation elements was assumed for the 
entire length of the flight line. The positional elements 
X i y • were assumed as second order polynomials. The 
fjyin§ height, Zfj, and the angle were assumed constant 
down the flight line. Since the scanner used was stabili- 
zed in 03, the term was taken as zero. The 4^ term was also 
taken as zero, due to its high correlation with Xc- 

In the second case, the same assumptions were made for the 
functional forms of the sensor exterior orientation ele- 
ments, but the flight line was broken into sections, each 
section having its own functional parameters - 

Tables I and II summarize the results obtained for flight 
no. 208. The residuals given are in terms of resolution 
elements at image scale. From Table I, treating the en- 
tire flight line as a unit, the reference variance obtain- 
ed, ^"'^was 1,73 with 68 degrees of freedom. In Table II, 
treating the data in five sections a pooled reference var- 
iance of 0.88 was obtained, with 54 degrees of freedom. 

An F test of these variances indicates a significant im^- 
provement at the 95% level in treating the data in sections 


17 



TABLS I 


Residuals for Flight No. 208, 
as a Unit 

Treating Entire 

Flight Line 

CONTROL 

RESIDUALS 

POINT 

X 

Y 

1 

-1.50 

-1.40 

2 

1.84 

-0.40 

3 

2.71 

-0.20 

4 

0.93 

1.24 

5 

1.25 

0.30 

6 

-2.82 

-2.26 

7 

0.22 

0.64 

8 

-1.72 

2.87 

9 

* 

* 

10 

, -1.32 

1.47 

11 

-0.77 

0.60 

12 

0.46 

-0.70 

13 

-0.91 

0.20 

14 

1.44 

-0.04 

15 

-1.15 

-0.02 

16 

-1.50 

0.01 

17 

-1.17 

-0.88 

18 

2.14 

0.30 

19 

2.38 

1.00 

20 

2.03 

-0.16 

21 

0.92 

-0.59 

22 

0.50 

-1.33 

23 

0.13 

-0.61 

24 

-0.34 

-0.61 

25 

-1.08 

-0.25 

26 

-0o20 

0.94 

27 

-0.85 

0.37 

28 

-0.13 

-0.37 

29 

-0.77 

0.22 

30 

-0.23 

0.83 

31 

-0.98 

-0.29 

32 

-2.14 

-0.22 

33 

-1.39 

-1.92 

34 

0.74 

-0.62 

35 

0.65 

-3.12 

36 

1.03 

0.55 

37 

1.88 

1.06 

38 

-1.03 

2.15 

39 

0.77 

0.83 

1.73, 1.31, 

d.f. = 68 



* Data point rejected due to data blunder 
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TABLE XI 


Residuals for Flight No. 208, Treating Entire Flight Line 
in Sections 

CONTROL BLOCK RESIDUALS 


POINT 

NUMBER 

X 

V 

X 

Y 

1 


0-42 

0-43 



2 


0.03 

-0.34 



3 


0.65 

-0.69 



4 


-0.70 

0.86 



5 

0-/= 0.47 

0.07 

-0.11 



6 

« 0.69 

-0.40 

-0.39 



7 

d.f. = 10 

-0.07 

0.26 



8 


-0.60 

0.70 . 

o 

• 

O 

0.52 

9 


it 

* 

•* 

. ♦ 

XO 


0.60 

-0.72 

-0.10 

-0.11 

IX 




-0.04 

-0.59 

12 

^ , II 



-0.05 

-0.34 

13 

= 0.45 



-0.37 

-0.12 

14 

<r, = 0.67 



1.35 

0.44 

15 

d.f. = 10 



-1.06 

0.57 

16 




0.26 

-0.14 

17 


-1.57 

-0.04 

-0.08 

-0.28 

18 


-1.69 

-0.89 



19 


i;59 

0.47 



20 

^ III 

1.89 

1.13 



21 

6;’-= 1.76 

1.11 

-0.01 



22 

^6 = 1-32 

-0.45 

-0.42 



23 

d.f. «= 10 

0.58 

-0.58 

0.50 

-0.41 

24 


-0.26 

0.15 

0.13 

0.19 

25 


-1.19 

0.18 

-0.34 

0.07 

26 




-0.72 

0.37 

27 

cr»*= 0.29 



0.36 

0.60 

28 

0i> =0.54 



-0.28 

-0.03 

29 

def- “ 10 

-0.28 

-0.12 

0.44 

-0.83 

30 


-0.39 

-0.32 

-0.32 

-0.15 

31 


-0.18 

1.07 

0.24 

0.20 

32 


-1.47 

1.32 



33 

CTo = 1.28 

-0.64 

-0.77 



34 


1.56 

0.12 



35 

d.f! = 14 

0.99 

-1.85 



36 


0.21 

-0.11 



37 


0.98 

0.25 



38 


-1.64 

0.80 



39 


0.08 

. -0.3^ 




Pooled <?•/= 0.88, pooled CTo= 0.94, pooled d.f. = 54 
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Table III sonunarizes the results obtained in treating fli- 
ght no* 218 as a unit* A reference variance of 6,03 was 
obtained, with 56 degrees of freedom. In Table IV, treat- 
ing the data in four sections, a pooled reference variance 
of the 3*46, with 38 degrees of freedom was obtained. An 
F test once again revealed a significant difference at the 
95% level, between the two -methods of analysis. 

Figure 11 depicts a visual grey scale representation of 
the data arrays for flight no. 208* Figure 11a shows 
the data before any geometric treatment, and figure lib. 
shows the results of treatment using collinearity equa- 
tions in five sections down the strip. Figure 12a depicts 
the uncorrected imagery for flight no. 218, and figure 12b 
illustrates the results after treatment using the colline-* 
arity formulation in four sections. 

Flow chart of MSS system analysis 

The following chart summarizes the system which has been 
presented in this paper for the geometric analysis of MSS 
digital Arrays. 
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TABLE III 


Reeiduals for Flight No. 218. Treating Entire Flight Line 
as a Unit. 


CONTROL 

POINT 

1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 


RESIDUALS 




6.03, 


2.46 

2.84 

- 3.42 

- 0.24 

3.24 

- 1.79 

2.77 

2.69 

- 2.57 

0.60 

- 4.71 

1.38 

- 3.35 

0.30 

1.98 

- 0.19 

- 0.26 

- 2.84 

- 0.34 

- 1.41 

3.35 

- 2.78 

1.68 

- 2.26 

0.72 

- 1.97 

- 3.60 

- 0.02 

- 2.10 

- 0.06 

0.69 

- 2.72 

2.69 

0.48 

- 0.19 

- 0.30 

5.65 

- 1.83 

- 1.91 

1.46 

loOl 

2.75 

lo 30 

1.56 

- 1.07 

1.15 

- 1.94 

4.37 

- 1«71 

2.29 

♦ 


- 1.24 

3.59 

- 2.27 

2.20 

2.12 

0.24 

- 2.36 

- 2.53 

3.57 

- 1.66 

0.89 

- 3.53 

0.23 

- 1.74 

2 . 46 , d . f . = 56 
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TABLE IV 


Residuals for Flight No. 218, Treating Flight Line in 
Sections 


CONTROL 

BLOCK 


RESIDUALS 


POINT 

NUMBER 

X 

Y 

X 

Y 

1 


1.59 

0.48 



2 


-4.50 

-1.16 



3 

8.38 

1.66 

0.25 



4 

= 2.89 

2.48 

0.61 



5 

d.f. = 6 

-0.26 

-0.89 



$ 


-2.26 

0.73 



7 


1.29 

-0.04 

0.04 

-0.19 

6 




-0.61 

1.56 

9 




0.58 

-0.84 

10 

<Ti,*= 0.81 



-0.31 

0.56 

11 

= 0.89 



0.17 

-0.96 

12 

d.f! = 10 



0.11 

-0.37 

13 




0.49 

-0.31 

14 




-0.04 

0.82 

15 


-0.35 

-0.69 

0.37 

-0.27 

16 


-1.22 

-0.59 



17 


2.S9 

lo23 



18 

Uo‘= 3.87 

-1.61 

0.83 



19 

1.97 

2.19 

-1.05 



20 

d.f. = 10 

-2.38 

-0.36 



21 


le07 

0.86 



22 


1.73 

-0.48 



23 


-2.02 

0.27 

-0.16 

-0.83 

24 




-0.59 

1.91 

25 




1.66 

-1.17 

26 




* 

it 

27 

IV 



-OoOl 

0.95 

28 

0^*= 2.87 



-lo09 

-0.06 

29 




-2o21 

0.22 

30 

d.f. s 12 



0.09 

-2.04 

31 




2.61 

0.30 

32 




-1.55 

0.02 

33 




1.04 

0.71 

^ -1 






Pooled *= 

= 3.46, pooled^ 

= 1.86, 

pooled d. 

£. ==38 
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CONCLUSIONS 


This paper was begun by a very brief survey of remote sen- 
sing systems in order to show how the MSS system under 
consideration is categorized. Because of the extensive 
amount of data acquired by the an automated digital 

technique based on pattern recognition and statistical 
classification algorithms has been developed by, and is 
used at, LARS of Purdue. Because, at the time the system 
was developed, the geometric factors of the sensor were 
subordinated to those of interpretive interest, it became 
apparent recently that an analysis of these factors would 
enhance the value of the acquired data. 

Instead of discussing the geometric factors of MSS as a 
separate and isolated problem, a philosophy was advanced 
at the beginning of this paper in which remote sensing in 
general is regarded as a mapping or transformation. This 
transformation should ideally operate on all variables in- 
volved, both metric and non-metric. Because of speci- 

fied purpose of the paper, we limited consideration to the 
four dimensions of geometric space and time- The develop- 
ment proceeded to deal with specialized cases and approxi- 
mations — all of which were shown to be included in the 
general transformation. The specializations were dictated 
by the fact that the research is being performed within the 
bounds of an already existing digital classification al- 
gorithm. The adoption of this course of action was mainly 
for reasons ' of expediency since it made possible the at“ 
tainment of some results, as given in the text. 

Ideally, one should strive to work with the unified con- 
cept. In addition to the metric variables considered, 
non-metric factors arising from the broad subject of in- 
t^j^QCtion between radiation and matter should also be taken 
into account in the transformation. Consequently, the ob- 
ject space vector may be enlarged to include: spectral 

radiance from each resolution element at a particular wave- 
length? polarization of the radiant energy with respect to 
the object space coordinate system; and the coherence, 
both spatial and temporal, of the radiant waves. Likewise, 
the sensor space vector may be expanded to include, spec- 
tral irradiance incident on the sensor, corresponding to 
each resolution element at a particular wavelength? polar- 
ization as to whether retained or not, and if retained its 
direction with respect to the sensor coordinate system? 
coherence, whether partially or totally lost? and frequency 
and phase shifts which are useful when active remote sen- 
sing systems are utilized. 

The ultimate in treating remote sensing systems is to seek 
as general a transformation as possible, that is, one 
^bich can be applied to any system. Such a transformation 
would include all elements involved, both metric and non- 
metric, and may be used both for interpretive as well as 
for quantitative purposes. The development of this con- 
cept is obviously well beyond the scope of. this paper. 
However, it is felt that the unified idea advanced here 
merits serious consideration and research is in fact con- 
tinuing on its development. 
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Allowable Height Assignment Error, 6Z 
as % of Flying Height Above Terrain 
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FIGURE 9 



FIGURE 10 
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FIGURE 11 
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